Scalable Bulk Data Transfer in Wide Area Networks
نویسندگان
چکیده
Bulk data transfer in wide area networks (WAN) requires scalable and high network bandwidth. In this paper, we identify a number of the scalability limitations that affect the full utilization of peak theoretical network bandwidth. In addition, we study and classify different offered approaches to overcome some of the identified limitations and increase network bandwidth among Grid components in WAN. With these limitations in mind, we study and evaluate the scalability and flexibility of a UDP-based multiple-network-interface socket (MuniSocket) model in WAN. The MuniSocket model is a middleware layer between the distributed applications and the multiple networks and system resources available. MuniSocket utilizes existing system resources, network interface cards, and network links to provide a scalable, reliable and high bandwidth network solution for data-intensive distributed applications, thus eliminating most of the identified limi-
منابع مشابه
High Speed Bulk Data Transfer on the Grid Using the SSH Protocol
SSH is a widely used multipurpose application for interactive shells, bulk data transfer, and other network transport needs. However, a design choice in most implementations of SSH reduces its functionality as bulk data transport tool in Grid and other high performance environments. In this paper I will discuss the nature of the design choice, the functional limitations it imposes, a method by ...
متن کاملApplied techniques for high bandwidth data transfers across wide area networks
Large distributed systems such as Computational/Data Grids require large amounts of data to be colocated with the computing facilities for processing. Ensuring that the data is there in time for the computation in today’s Internet is a massive problem. From our work developing a scalable distributed network cache, we have gained experience with techniques necessary to achieve high data throughp...
متن کاملA Flexible Bandwidth Reservation Framework for Bulk Data Transfers in Grid Networks
In grid networks, distributed resources are interconnected by wide area network to support compute and data-intensive applications, which require reliable and efficient transfer of gigabits (even terabits) of data. Different from best-effort traffic in Internet, bulk data transfer in grid requires bandwidth reservation as a fundamental service. Existing reservation schemes such as RSVP are desi...
متن کاملAn Adaptive File Distribution Algorithm for Wide Area Network
This paper describes a data distribution algorithm suitable for copying large files to many nodes in multiple clusters in wide-area networks. It is a self-organizing algorithm that achieves pipeline transfers, fault tolerance, scalability, and an efficient route selection. It works in the presence of today’s typical network restrictions such as firewalls and Network Address Translations, making...
متن کاملGlobus GridFTP : What ’ s New in 2007 ( Invited Paper )
GridFTP is a high-performance, secure, reliable data transfer protocol optimized for high-bandwidth wide-area networks. It is based on the Internet FTP protocol, and it defines extensions for high-performance operation and security. The Globus implementation of GridFTP provides a software suite optimized for the gamut of data access issues—from bulk file transfer to the details of getting data ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IJHPCA
دوره 17 شماره
صفحات -
تاریخ انتشار 2003